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The RICIS Concept 


The University of Houston-Clear Lake established the Research Institute for 
Computing and Information Systems (RICIS) in 1986 to encourage the NASA 
Johnson Space Center (JSC) and local industry to actively support research 
in the computing and information sciences. As part of this endeavor, UHCL 
proposed a partnership with JSC to jointly define and manage an integrated 
program of research in advanced data processing technology needed for JSC’s 
main missions, including administrative, engineering and science responsi- 
bilities. JSC agreed and entered into a continuing cooperative agreement 
with UHCL beginning in May 1986, to jointly plan and execute such research 
through RICIS. Additionally, under Cooperative Agreement NCC 9-16, 
computing and educational facilities are shared by the two institutions to 
conduct the research. 

The UHCL/RICIS mission is to conduct, coordinate, and disseminate research 
and professional level education in computing and information systems to 
serve the needs of the government, industry, community and academia. 
RICIS combines resources of UHCL and its gateway affiliates to research and 
develop materials, prototypes and publications on topics of mutual Interest 
to its sponsors and researchers. Within UHCL, the mission is being 
implemented through interdisciplinary involvement of faculty and students 
from each of the four schools: Business and Public Administration, Educa- 
tion, Human Sciences and Humanities, and Natural and Applied Sciences. 
RICIS also collaborates with industry in a companion program. This program 
is focused on serving the research and advanced development needs of 
industry. 

Moreover, UHCL established relationships with other universities and re- 
search organizations, having common research interests, to provide addi- 
tional sources of expertise to conduct needed research. For example, UHCL 
has entered into a special partnership with Texas A&M University to help 
oversee RICIS research and education programs, while other research 
organizations are involved via the "gateway" concept 

A major role of RICIS then is to find the best match of sponsors, researchers 
and research objectives to advance knowledge in the computing and informa- 
tion sciences. RICIS, working jointly with its sponsors, advises on research 
needs, recommends principals for conducting the research, provides tech- 
nical and administrative support to coordinate the research and integrates 
technical results Into the goals of UHCL, NASA/JSC and industry. 
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A DEMPSTER-SHAFER BASED APPROACH TO COMPROMISE 
DECISION MAKING WITH MULT I ATTRIBUTES 
APPLIED TO PRODUCT SELECTION 


The Dempster-Shafer theory of evidence [7] is applied to 
a multiattribute decision making problem whereby the decision 
maker (DM) must compromise with available alternatives none of 
which exactly satisfies his ideal. The decision mechanism is 
constrained by the uncertainty inherent in the determination 
of the relative importance of each attribute element and the 
classification of existing alternatives. The classification of 
alternatives is addressed through expert evaluation of the 
degree to which each element is contained in each available 
alternative. The relative importance of each attribute element 
is determined through pairwise comparisons of the elements by 
the decision maker and implementation of a ratio scale 
quantification method. Then the Belief and Plausibility that 
an alternative will satisfy the decision maker's ideal are 
calculated and combined to rank order the available 
alternatives. Application to the problem of selecting computer 
software is given. 
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I . INTRODUCTION 


in this work we consider the problem of how to select a 
course of action when imperfect information is present. To 
make a decision, we look at designated attributes where each 
attribute has element values which may not be numerical. As an 
application, we will consider the problem of selecting 
software based upon the attributes of on-line help files 
(Help) and written documentation (Documentation) ; evaluating 
the elements of attribute Help as undesirable, acceptable, or 
desirable and the elements of Documentation as inadequate, 
adequate, and extensive. 

Experts create a database where each alternative is 
classified relative to the amount by which each attribute 
element is present in each alternative. In our application, 
the degree to which the user/ expert thinks a particular 
computer software package has an undesirable, acceptable, or 
desirable on-line help file is reflected in the assignment of 
weights to the elements; Undesirable Help, Acceptable Help, 
and Desirable Help. Every alternative will have such a 
classification for this attribute's and every other 
attribute's elements under consideration by the decision 
maker. This kind of classification reflects human uncertainty 

inherent in subjective judgments. 

The uncertainty of subjective judgment is also present 
when a decision maker has to specify an optimal alternative. 
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The reason is that often an alternative is chosen by 
compromising according to the degree to which different 
attributes have distinct values. To determine this degree (or 
mass function) for each attribute, we determine the relative 
weight of importance of each attribute's elements. In our 
application, this is accomplished through the decision maker's 
pairwise comparisons of the elements of Help and 
Documentation, and the use of Guilford's ratio scale 
quantification process (5]. The optimal or ideal is formed by 
the relative weights for each attribute's elements combined 
over all attribute mass functions. For our application, Ideal 
m Documentation + Help. 

To deal with the type of uncertainty present in the 
decision making situation described above, techniques other 
than classical logic need to be used. Although statistics may 
be the best tool available for handling likelihood, in many 
situations inaccuracies may result since probabilities must be 
estimated; sometimes without even the recourse to relative 
frequencies. The Dempster-Shafer theory of evidence [7] gives 
useful measures for the evaluation of subjective certainty. 
Fuzzy set theory is another tool used to deal with uncertainty 
where ambiguous terms are present. In the next section, we 
give the background information on fuzzy set theory and the 
Dempster-Shafer theory that is necessary to carry out our 
decision algorithm (see section IV) under the uncertainties 
pertaining to expert judgment and knowledge acquisition. 
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II. BACKGROUND 

Let X * {x, x 2 , x n ). The fuzzy subset of X is 

defined by a function from X into [0,1] ( [2 ] , [6] , [ 10] ) . That 
function is called the membership function. The notation 
E, o, / x, will refer to the fuzzy set whose membership 
function at x, is a,. If A and B are fuzzy subsets of X, 
and if and /i, are their membership functions then the 

membership functions of A/\B, AVB and —A are M A VM a and 

1 - This last expression denotes the fuzzy complement of 
A. (For additional details, see Zadeh [10].) 

By a mass function on X we mean a function, m ,that maps 
subsets of X into the reals with the properties: 

(i) m(o) - 0, m(A) £ 0 

(ii) Z AcX m(A) - 1 

Subsets of X over which m is not zero are called focal 
elements of m. That is, U is a focal element of m if m(U) >0. 
If m, and hLj are two masses on X, then the direct sum of m, 

and b»2 is defined by (m, ® ntj) (A) * ^Bnc«* ^(C) / ^snc** 

m,(B) m 2 (C) if A # e . Here B and C denote (fuzzy) 

focal elements of m 1 and m 2 . Of course, A denotes a typical 
(fuzzy) focal element of m 1 ® m 2 . Thus the focal elements of 
m, # m 2 are obtained by intersecting the focal elements of m^ 
and m 2 . We set (m, ® m 2 ) (e>) = 0. (For additional details, see 
Shafer [7].) 

This rule of composition applies when m, and m 2 come from 
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independent sources of information and represent the mass 
generated by these two sources. The direct sum is a construct 
that sometimes models well the information gathered from 
independent sources of information, but this is not always the 
case. For a discussion of this, the reader is referred to the 
article by L.A. Zadeh [12]. In this context, the set X is 
often called the universe of discourse. 

A mass function, m, on the universe of discourse, X, 
generates two important set functions defined on the sets of 
X. These are the belief and plausibility functions : 
Bel (B) - £ AcJ m(A) and Pis (B) - m(A) . The belief and 
plausibility functions denote a lower and an upper bound for 
an (unknown) probability function. For example, let S denote 
some area where oil may be present. 



Figure 1: Figure 2: 

In Figure 1, we have five experts locating points where oil 
could be found. Three of the five experts have located oil 
inside the area S, and two experts have located oil to be 
outside of S. We could say that the probability of oil inside 
S is 3/5, since we have three hits out of five. In Figure 2 we 
have seven experts locating oil. These experts are not totally 
sure of themselves so the i th expert locates the oil to be 
anywhere in A, rather than at one specific point. Under these 
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circumstances, the probability of the oil being inside S is 
not defined, since the fourth and fifth expert are indicating 
that the oil might be inside or outside of S. If we seek the 
lowest possible probability that oil exists in S, we have 3 
hits out of 7. If we want the highest probability we can say 
that we have 5 hits out of 7. The lowest probability is called 
belief and the highest probability is called plausibility. 

If we define the focal elements of m to be {A,, Aj, 
...A 7 ) with m(Aj) - 1/6; 1 £ i < 7. Then m, is a mass function; 
Bel (S) » m(A,) « 3/7 and Pls(S) - E s , , m(A,) « 5/7. 

It is clear that if the sets A, are reduced to specific 
points, then Bel and Pis are equal and reduce to a probability 
function. Thus a probability can be viewed as a belief (or a 
plausibility) where the focal elements are points. The 
converse is not true; e.g. a belief function may not be viewed 
as a probability and the usual axioms for a probability 
function do not apply to a belief function. In fact, the 
formal axioms for a belief function are: 

(i) Bel (e) * 0 and Bel(X) = 1 

For every collection of subsets, A^, Aj, . • • , A n 

(ii) Bel^uAjU. . .A n ) S(-l) S 1 ** 1 Belfry A,) 

where I ranges over all non-empty finite subsets of 
( 1 , 2 , . . . , n ) and |l| denotes the cardinality of I. Any such 
function can be defined in terms of a mass m defined by 
m(A) = E(-1) |a ' b| Bel (B) where | A-B | is the cardinality of 

BcA 

the set A n -B. Then Bel (B) * E ro(A) . 
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A belief function is called Baysian if 

(i) Bel ( 0 ) = 0, Bel (X) = 1 

(ii) Bel(AuB) * Bel (A) + Bel (B) 

whenever A and B are disjoint. It may be shown that the 
following conditions are equivalent 

(i) Bel is Baysian 

(ii) Focal elements are points 

(iii) Bel (A) + Bel (-A) = 1 

in the present work, it will be very natural to extend 
this setting to the case where focal elements are fuzzy 
subsets of the universe of discourse. This setting was first 
considered by Zadeh [11], but Yager [8], among others, has 
done similar work. We would also refer the reader to a paper 
on the theory of masses over fuzzy sets by Yen [9], since we 
will define the different attributes and the ideal in those 

terms. 

To begin the compromise decision making process, a set 
of alternatives h 1f h 2 , ...h t is defined. For our example, 

these will be different software packages under assessment for 
selection by the user. Let F^, F 2 , •••, F n denote a list of 

attributes considered to be important to the decision maker in 
the evaluation of the alternatives. For example, F, could be 
Documentation, F 2 could be Help, etc. Let f, < denote 
elements of the attribute, F jf where 1 < i < n and 1 < k, < n,. 
For example, if i = 1; f,\ f, 2 , *i 3 could denote Inadequate 

Documentation, Adequate Documentation, and Extensive 
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Documentation, respectively. Associated with each alternative, 
h we have n fuzzy sets corresponding to the n different 

j ' nj 

attributes. Thus, h ) is associated with^ a^i / f ( < where 
a. K i is the amount to which element f, K ) of attribute F i is 

( j 

present in alternative h j ; 1 < i ^ n and 1 ^ j < t. For our 
example, the first computer package could be associated with 
. 4/Inadequate Documentation + .5/Adequate Documentation + 
. 1/Extensive Documentation + . 3/Undesirable Help + 

. 6/Acceptable Help + . 1 /Desirable Help , if we are concerned 
with the attributes, Documentation and Help. 

We recognize that the decision maker may desire a 
particular element from the attributes under consideration 
more than another element. C.H. Coombs [4] proposed that there 
is such an ideal level of attributes for objects of choice. 
Using the notation for any alternative given above, we may 
express the ideal alternative as n fuzzy sets: 

j"* d, K i / f, K « , 1 i i < n and 1 < k, 5 n, where d, K » expresses 

' K 
to what degree the decision maker wants element f, \ of F t . 

We may use a process such as Guilford's constant-sum method 

[5] to assist the DM in the evaluation process to determine 

his degree of preference for each fj K < of Fj. 

The assigning of relative weights of importance through 

pairwise comparisons of each attribute's elements asks the 

decision maker (s) to distribute a total of 100 points between 

the elements of each pair in the same proportion as the 

relative value of the two elements with respect to each other 
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have been made, the 


[3 ). After all of the comparisons 
subjective values implicit in the decision maker's judgment 
are recovered through use of a ratio scale method ([3], [5]). 

The use of Guilford's [5] ratio scale method also allows the 
decision maker's consistency of judgment to be monitored [1]. 
It is necessary that the DM's ideal be as accurate as possible 
with respect to consistent weights of relative importance for 
each attribute's elements since these values form mass 
functions that ultimately influence the belief and 

plausibility of each alternative. 

As Zeleny [14] suggests, the ideal serves as a minimum 
requirement for intelligent discourse. This ideal as generated 
by the relative importance weights of each attribute's 
elements reflects the decision maker's cultural, genetic, 
psychological, societal, and environmental background [13]. As 
a relatively unstable, context-dependent concept of 
informational importance, these weights are reflective of a 
given decision situation [13]. Thus, the relative importance 
values determined by the decision maker may vary for different 
sets of attribute elements, thereby altering the mass function 

associated with each attribute. 

These mass functions contain focal elements which can be 

viewed as fuzzy subsets of alternatives. In other words, we 
can express each element of an attribute as a fuzzy set, F,‘i, 

. . — Undesirable _ 

of alternatives. For our example, we can write f h£LP 

,3/h, +.5/h 2 +... + . 8/h, if V s Hel P has baen evaluated as - 3 
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. 5 Undesirable, 


Undesirable, h,'s Help has been evaluated as 
etc. Using previous notation, we determine, F, ■ as 
jj o„ r i / h, where; 1 £ i S n and 1 < k, S n ( . Thus, associated 
with each element, f,«. of each attribute, F„ we can define 
fuzzy focal elements, F,«i, over which mass functions can be 
determined. Indeed, we can define n masses, m, (1 S i S n) 
in terms of the ideal weight of each element, f, K i for each 
attribute, F, so that m, ( F, K i) ■ d,'i; 1 S i S n and 1 £ k, S n,. 
K. define ■ by, m - m, e . . . e m„ where we use the combination 
zuie [ 7 j , thereby forming mass function m over the 

intersection of finite sets of focal elements, F, K f . We let A. 
be the fuzzy focal elements of m. For our example, we have 
nine fuzzy focal element sets, A., formed from the two 
attributes Documentation and Help, each of which has three 
elements. (See section III) . Using the definition of m, we can 
determine the mass function, m, defined over the intersection, 

A a , of focal elements, F,*i of m r 

Following Zadeh's notation [11], we generalize the belief 

and plausibility function to: 

Bel (B) - E a inf (A a - B) m(A a ) and 
Pis (B) - sup (BAA a ) m(A a ). 

and A - B is defined to be -A.VB. We now show that the 

fit 

definitions given are natural extensions of the crisp 

case. [11] We have (A a - B) (x) * (-A a VB) (x) 

= Max (1-A a (x) , B(x) } 
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inf (A - B) = inf Max{ 1 - A a (x), B(x) ) 

* a * 

When A and B are crisp sets. 

8 

A # (x) = 1 if x e A,; A,(x) = 0 if x C A # 

B(x) * 1 if x e B; B(x) = 0 if x C B 
Thus, 

inf Max(l-A a (x), B(x) } ■ 1 if «•»» ° nl r if for aU *' 
A.(x) - 0 or B(x) - If x « A. or x e B. This says that 
inf Max(i-A.(x) , B(x) ) - 1 if and only if A. c B. Since the 
above expression can only be 0 or 1, in the crisp case, 
inf Max(l-A.(x), B(x) } - 0 if and only if A. * B. 

X 

Thus, 

inf (A, - B) - 1 if and only if A. c B; otherwise 
inf (A. -* B) * 0. 

in the crisp case, the belief becomes c , »(A.) which 

coincides with the definition of Bel (B) given previously for 
the crisp case. Similarly, in the crisp case, 

sup(B A A.) = Max Min (B(x), A. (x) } -.1 if and only if 
B(x) =1 and A, (x) = 1 for some x. That is, if xcB and xcA. 

for some x. Thus, in the crisp case sup(B A A a ) - 1 if 
only if B A A a «* 0? otherwise sup (B A A.) = 0. The 

plausibility for the crisp case, then becomes *(A a ) 

which coincides with the definition previously given for the 

crisp set. 

We would like to specialize to the case where B -(h,). We 

have: 

Bel {hj } = £ a inf (A a - h^) m(A a ) 
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We begin by noting inf (A a - hj) * inf Max( 1 - A a (x) , hj(x) } 
where x ranges over {h,, h 2 ,...}. Thus, hj(x) = 1 if x - hj and 
hj (x) = 0 if x * hj. Therefore, 

inf Max{ 1 - A # (x), hj(x)} = inf x , h Max{ 1 - A a (x),0) 

- 1 " V x)) 

- 1 “ Max^A.fX) 

so inf (A. - hj) * 1 - Max x#hj A a (x) 
so Bel(hj) - S a (1 - Max x , hj A a (x)) *(A a ) 

Similarly, it can be shown that the plausibility is given by: 

Pls(hj) * Z a A a (h^ m(A a ) . 

It should be noted that in crisp sets, plausibility is 
always greater than or equal to belief. Comparing the 
coefficients of the i th terms for plausibility and belief, we 
have A, (hj) and l-Max X( ^ ^ A, (x) , respectively. Indeed, 
if A, is a crisp set, 1-Max x#h j A, (x) € (0,1). It is equal 
to 1 if and only if Max x#hj A,(x) - 0 which implies that A, = 
(hj). This, in turn, implies that hj € A, which implies that 
{hj} = i. in our research, we are not dealing with crisp 
sets, so plausibility is not necessarily greater than or equal 
to belief. 

The gap between the plausibility and the belief of hj 
represents the doubt about alternative hj. If Pls{hj) is high 
then the belief in the competing set is low since 1 - Pls{hj} 
= Bel(-'hj). Hence, one way to select an alternative is to pick 
the alternative with the highest belief. Perhaps, a more 
sophisticated way is, in addition to the belief, compute 
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Bel ) . It may be more desirable to pick an alternative 
whose belief is not a maximum when the belief in competing 
alternatives is low. In particular, if we consider the 
difference between the belief in an alternative and the belief 
in the competitors of that alternative: Bel {h,} - Bel {-^J 
- Bel (hj ) - (1 - Pls{hj ) ) . Thus, the deciding factor for 

ranking the alternatives from highest to lowest could be 
Bel (hj) + Pis (hj). 


III. EXAMPLE 


The process developed in this paper allows the software 
user to actively participate as a decision maker in the 
selection of a set of packages by specifying a graded 
possibility distribution for each attribute that forms his 
ideal alternative. The Dempster-Shafer rule of combination of 
evidence evaluates information from independent alternatives 
to assess the degree of belief that each available package 
will satisfy the user's ideal. The set of packages to purchase 
is the set that has a relatively high belief and also a 
relatively high plausibility which implies that the set of 
competing packages has relatively low belief. For example, if 
the belief in an alternative is 0.7 and plausibility is 0.6, 
then the belief in the competition is 1 - 0.6 = 0.4. If, on 
the other hand, the belief is 0.5 and the plausibility is 0.9 
then the belief in the competition is 1 - 0.9 - 0.1. Although, 
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the belief in the second alternative is lower than the first, 
the combination of belief and plausibility is greater. This 
fact, plus the lower belief in the competition's ability to 
satisfy the decision mater mates the second alternative the 


more viable choice. 

Most computer users would lite software pactages to be 
extremely user friendly. Possible attributes that would help 
accomplish this goal include: i7 pull-down menus, 2) built-in 
model editors, 3) output viewer, 4) on-line help, S) automatic 
menu selection, 6) explicit documentation, 7) ease of 
debugging, 8) printing buffer, 9) computational speed, and 

10) helpful execution error messages. 

Let us consider a very simple example of this software 
selection problem whereby the attributes of importance to the 
decision maker/user are the documentation (Documentation) and 
on-line help (Help) . The DM determines his highest attainable 
degree of satisfaction for Documentation = (inadequate, 
adequate, extensive) and Help - (undesirable, acceptable, 
desirable). The decision maker performs pairwise comparisons 
of each possible Documentation and Help element, allocating 
100 points to indicate his relative preference for one element 

over another . 

Given the example above with three elements for 
Documentation, three pairwise comparisons would be made. The 
decision maker may assign the following: 
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Inadequate 

Adequate 


Adequate 60 
Extensive 4 0_ 


Extensive 7 5_ 
inadequate _ 25 


to indicate that a package with adequate documentation is 
almost six times as important to him as a package with 
inadequate documentation, while software with extensive 
documentation is three times as important as a package with 
inadequate documentation. However, adequate documentation is 
one and one half times as important as extensive 
documentation. This indicates that the DM will in all 
likelihood compromise between a package with adequate and 
package with extensive documentation, but is unlikely to 
accept one with inadequate documentation. This decision maker 
may have assigned these values because of experience with 
extensive documentation that although extensive is frequently 
too cumbersome and less useful for the occasional user than 
on-line help. Adequate documentation with a desirable on line 
help is preferable to this decision maker. This is further 
supported by the decision maker's relative weights whereby 
desirable on-line help is more important than acceptable help 
and undesirable help is virtually not a consideration. 

Using the DM's pairwise comparisons, the following 
calculations would be performed with Guilford s constant sum 
method ([3], [5]). Matrix A is composed of all a 5j such that 
a = the allocation of element j when compared to element i. 
For our example, Matrix A would be: 
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Inadequate 

Inadequate 

Adequa te 
85 

Extensive 

75 

Adequate 

15 

— 

40 

Extensive 

25 

60 


Next, Matrix B 

is formed 

such 

that b (j = 


Calculating from Matrix A for our example, Matrix B would be 


Inadequate 

Adequate 

Extensive 

Finally, Matrix C 


Inadequate Adequate 


1.00 

5.67 

0.18 

1.00 

0.33 

1.50 

formed as 

C U 


Extensive 

3.00 
0.67 

1.00 

*>„ / J4i where i= 


n and j-1,2, ... ,n-l. Matrix C for our example is 


Inadequa te 
Adequa te 
Extensive 

y 

o 


Inadequa te/ Adequa te 
0.18 
0.18 
0.22 
0 . 19 
0.001 


Adequa te/ Extensive 
1.89 
1.50 
1.50 
1.63 
0.05 


Although all elements of a column represent the same 
ratio, they are not necessarily equal to one another. This is 
because of the inconsistencies in human judgment. A standard 
deviation beyond 0.05 has been shown to indicate a significant 
inconsistency of judgment by the decision maker [1]. It is 
suggested that the DM be encouraged to reevaluate his pairwise 
comparisons if this occurs. The column means as the average 
ratios of the decision maker are used to smooth out the 
variations. Assigning 1.00 to Extensive, Adequate 
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(1.63) (1.00) = 1.63; and Inadequate * (0.19) (1.63) 0.3097. 

Normalizing and rounding to tenths, the relative weights of 
the decision variables, d,‘., are - 0.1; <W“ w " 

-0.6; and d MC E «""> 1 '* - 0.3. 

The pairwise comparison process would be repeated for 
each element, f, k i, of the designated attributes to determine 
the user's ideal as 5 d, k i / f, k i • Using the weights we 

V 1 

determined for the Documentation elements and assuming the 
following relative importance weights have been determined for 
the Help elements, the ideal could be expressed as Ideal - 
Documentation + Help where: Documentation: 0 . 1 / Inadequate + 

0.6/Adequate + 0.3/Extensive and Help: 0.1/Undesirable + 

0.4/ Acceptable + 0.5/Desirable. Thus, the ideal indicates the 
highest attainable degree of satisfaction of the decision 
maker in compromising between the elements of specific 
attributes. 

This information is next combined into F, the set of all 
possible combinations of different attributes' elements. These 
are the focal elements of the combined mass. For our example, 
we have nine focal elements such that 
p> s (inadequate Documentation A Undesirable Help, 

Inadequate Documentation A Acceptable Help, 

Inadequate Documentation A Desirable Help, 

Adequate Documentation A Undesirable Help, 

Adequate Documentation A Acceptable Help, 

Adequate Documentation A Desirable Help, 
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Extensive Documentation A Undesirable Help, 

Extensive Documentation A Acceptable Help, 

Extensive Documentation A Desirable Help) 

The company's software experts must now select packages 
that will closely approximate the user's ideal or specify 
doubt that such a match exists at this time. Contained m a 
database, the expert has tested all new software packages and 
evaluated them according to designated attributes. For our 
application, the DM has selected Documentation and Help. 
Suppose the software expert ( s) ' evaluations yielded: 

Package 1 = o.3/Inadequate Documentation+ 0.7/Adequate 
Documentation-*- 0.2/Extensive Document at ion+ 

0 . 4 /Undesirable Help + 0 . 2 / Accept able Help + 
0 . 6 /Desirable Help? 

Package 2 * 0 . 5/ Inadequate Documentation-*- 0.6/Adequate 

Documentation + 0.3/Extensive Documentation-*- 
0 . 6/Undesirable Help + 0.4/Acceptable Help + 
0 . 8 /Desirable Help; and 

package 3 = 0.4/ Inadequate Documentation-*- 0.1/Adequate 

Documentation + 0.7/Extensive Documentation-*- 
0 . 1 /Undesirable Help + 0.8/Acceptable Help + 

0 . 6/Desirable Help. 

Note that the decision maker's ideal is expressed in 
relative importance terms and the sum of the weights for each 
attribute will be 1.00. However, the expert is not attempting 
to evaluate each package according to a relative value for 
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each attribute's elements, but instead to indicate to what 
extent he feels the software satisfies the attribute element 
under consideration. 

We now form the set B that associates all focal elements 
in Documentation as: 

B~{Fg£ d0quMt * . Fg 0Miv0 ) 


where 


F . 3 / packagel ♦ . S/Package2 * . 4 / Packaged 
f'axr N7U * t " = • 7 / Packagel + . 6 /Package 2 * . 1/ Packagel 
FSc ' w “ 1v *« . 2/ Packagel + . 3/Package2 + . 7 / Package 3 

The set C associates all focal elements in Help as 

F^S pab, \ fvSS 1 '*"*) 


where 


• 4 / Packagel + . 6/Package2 + . 1 / Package 
F£££ pCmbl *= • 2 / Packagel + . 4 / Package2 + . 8 / Package 
FmLP Xmbl * m • 6 /Packagel + . S/Package2 + . 6 /Package 

in order to determine the value represented, by the 
intersection of different focal elements of Help and 
Documentation for each package as it relates to the DM s 
ideal, mass functions are specified for each focal element as. 


z — Inadequate \ 
m x ( F DOC ) 

, „ Adequate k 
Ml \ F doc ' 

_ / — Extensive*. 

Ml v F doc ) 

t Undesirable ^ 




_ / n^cce 

^2 > ^ HELP 


Accept 


) 


( HELP > 


= 0.1 
= 0.6 
=0.3 
= 0.1 
=0.4 
= 0 . 5 
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Then the mass function for each focal element of the two 
attributes can be expressed as: 

where B and C represent focal elements of i,, and A, is the 
i th focal element of m. 

For this example, 

a m (F O*d0'U*>l») , (o.l) (0.1) = 0.01 

s 4 * m(A 1 ) * m^KFooc i«h\*KXLP > 

where A, - Inadequate Documentation A Undesirable Help 

Aj - Inadequate Documentation A Acceptable Help 

A^ * Inadequate Documentation A Desirable Help 

A 4 * Adequate Documentation A Undesirable Help 

A, * Adequate Documentation A Acceptable Help 

A « Adequate Documentation A Desirable Help 
6 

A 7 * Extensive Documentation A Undesirable Help 
Ag - Extensive Documentation A Acceptable Help 
A, = Extensive Documentation A Desirable Help 
and m(A 2 ) = 0.04, m(A 3 ) - 0.05, m(A 4 ) - 0.06, m(A 5 ) = 0.24, 
m(A 6 ) = 0.30, m(A 7 ) = 0.03, m(A # ) - 0.12, and m(A^) = 0.15. 

The least likelihood that the package will satisfy the DM 
is determined for each A a , i = 1 ,.**, 9 » by comparison of the 
attribute values for each package and the selection of the 
minimum. For example, A 1 = Inadequate Documentation A 
Undesirable Help suggests the function min (0.3/Inadequate 
Documentation, 0.4/Undesirable Help) / Packagel + min 
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(0 . 5/Inadequate Documentation, 0 i. 6/Undesirable Help) / 

Package2 + min (0.4/Inadequate Documentation, 0. 1/Undesirable 
Help) / Packages or A, = 0.3 / Packagel + 0.5 / Package2 + 
0.1 / Package3. 

The Belief in the j th alternative is calculated as: 

Bel ( Package j) < 1“Pa.( x * )m{A m ) 

Then Bel(Packagel) - (0.5) (0.01) + (0.6) (0.04) + (0.5) (0.05) 
+ (0.4) (0.06) + (0.6) (0.24) + (0.4)(0.3) + (0.7)(0.03) + 

(0.3) (0.12) + (0.4) (0.15) - 0.459. Similarly, Bel ( Package 2 ) - 
0.529 and Bel { Package3 ) = 0.552. Thus, the third package has 
the highest degree of belief in satisfying the decision 
maker's ideal. Using belief alone, the ranking would be 

Package 3, Package 2 and Package 1. 

Now the plausibility of Package, in our example is: 

Pis {Package]) =1, A, { Package^ m(A m ) 

and thus, the Pls(Packagel) - (0.3) (0.01) + (0.2) (0.04) + 

(0.3)(0.05) + (0.4) (0.06) + (0.2)(0.24) + (.6)(0.30) 

(0.2) (0.03) + ( 0 . 2 ) (0.12) + (0.2) (0.15) = 0.338. Similarly, 
Pis (Package2 } = 0.448 and Pis (Package3) = 0.274. 

The interval of uncertainty for each package j is 
[ Bel ( Package,}, Pis ( Package, }] . Thus, the interval of 
uncertainty for Package 1 is [0.459, 0.338): for Package 2 is 
[0.529, 0.448); and for Package 3 is [0.552,0.274], 

As stated earlier, we recommend a maximizing of belief 
and plausibility be accomplished through a simple sum of 
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belief and plausibility. Using this ordering process and 

combining all evidence for any alternative, yields 0.797, 
0.977, and 0.826; for Packages 1, 2, and 3, respectively. This 
would lead to a suggested final ordering of Package 2, Package 
3, and then Package 1 based upon the user's ideal 
specification of attributes under consideration and the 
software expert's opinion of how each alternative satisfies 
those attributes . 

IV. ALGORITHM 

in general, the following algorithm can be applied to 
numerous multiattribute problems requiring a ranking of 
existing alternatives: 

1 . Define ( hj j-1,2 t) as a set of existing alternatives; 

F, for i*l, 2 , . . . ,n as a list of attributes. 

2 # Let f{ K i denote elements of the attribute, Fj, where 
1 < k, £ n, and 1 < i £ n. 

3. Obtain focal elements, F^i, from ’/t* */ where 

the amount to which the value f^ is present in alternative 
h } according to the expert; l £ k, < n, and 1 < j < t. 

4. Determine the ideal alternative as n fuzzy sets : 
Z d K i / f K i 1 < k f < n jf where d.*; expresses to what 
degree the decision maker wants element f, K i of F ( ; 

1 < kj < n s and 1 < i ^ n 

5. Define n masses, m ( (l < i S n) by m ( ( F i ’) " d i ’■ 

6. Let m be defined by m = m, ® ... ® m n • 
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7 . Determine Bel(hj) - £ a (i " ^.^ x ^ m(A a ) and 

Plslh,) - Z. A. (hj> m(A.) where A. are furry focal elements 

of in. 

8. Determine Bel {h^} + Pis {hj}. 

9. Rank order alternatives from highest to lowest value. 

V. CONCLUSION 


In designing a decision making model like that which is 
detailed in the preceding algorithm, we must: 

1) simplify the complex systems 

2) incorporate subjective factors in a systematic way 

3) pool evidence from independent sources of information, 

and 

4) account for the uncertainty inherent in the complex 
decision making process. 

It is obvious that the steps above are not independent. 
For example, when simplifying complex systems, many components 
are lumped together and therefore uncertainty builds up. This 
uncertainty is not only unavoidable, but in many cases is a 
by-product of taking correct steps to reduce complexity. Often 
diverse pieces of evidence are available. The features or 
attributes to which we have access are typically from 
different databases. in order to identify the closest 
available alternative to some simplified ideal, it is crucial 
to combine evidence about all of the attributes considered 
important to the decision maker. Thus, given a list of 
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possible decisions, and information about different attributes 
impacting the decision, we apply the Dempster-Shafer theory of 
combination of evidence to ranR order alternatives to most 
likely satisfy the DH's ideal. Subjective factors are 
incorporated in the determination of this ideal and the 
evaluation of the available choices. Combining the information 
from these independent sources allows a reasonable response 
time to a complex decision. 

The Dempster-Shafer based approach to the technology 
assessment problem presented in this paper is designed to aid 
in determining available package(s) best suited to a potential 
user's ideal specifications. A complete assessment of 
software packages would involve at least the ten factors 

mentioned at the beginning of the example. 

It is clear that this method generalises to other 
situations of technology assessment. The method is 
computationally intensive but can be shown to be significantly 
faster if a hierarchical structure of evidences is present. 
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